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MINIMUM-ERROR  TRELLIS-PATH  DECODERS  FOR  CONVOLUTIONAL  CODES 

I.  S.  Reed 

I.  INTRODUCTION 

This  is  the  final  report  on  a  one-year  study  of  techniques  for  improving 
and  simplifying  the  decoding  of  convolutional  codes  (CCs).  The  approach  to 
this  problem  was  to  first  review  and  extend  the  present  knowledge  of  the  alge¬ 
braic  structure  of  CCs.  This  included  a  study  [1]  of  both  the  generating  and 
parity-check  matrices  and  the  relationships  they  satisfy.  These  ideas  were 
then  used  to  characterize  the  syndromes  of  an  (n,  k)  CC  and  to  find  the  most 
general  solution  of  the  syndrome  equation. 

Next,  it  was  shown  [2]  how  the  concepts  that  were  further  developed  in 
Ref.  1  could  be  used  to  realize  a  Viterbi-like  syndrome  decoding  algorithm 
for  (n,  k)  CCs.  In  order  to  develop  a  sequential  syndrome  decoder  for  CCs 
as  well,  the  concept  of  an  error  tree  or  trellis  was  Introduced  [3].  Then, 
the  Fano  metric  for  use  in  sequential  decoding  was  studied  and  subsequently 
modified  [3]  so  that  it  now  applies  to  sequential  syndrome  decoding  of  CCs. 

In  the  last  quarterly  report  [4],  the  concepts  developed  in  the  previous 
three  reports  were  applied  to  the  creation  of  a  sequential  syndrome  decoding, 
algorithm  for  the  general  (n,  k)  CC.  For  this  new  algorithm,  it  was  shown 
how  to  find  the  syndrome  of  the  received  code,  to  sequentially  solve  the  syn¬ 
drome  equation,  to  graph  the  solutions  of  the  syndrome  equation  on  an  error 
tree  or  trellis,  and,  finally,  how  to  utilize  a  modified  form  of  Fano's  metric 
to  sequentially  produce  the  minimum  error  sequence  and  to  correct  the  received 
message.  All  parts  of  this  new  sequential  decoding  algorithm  were  illustrated 
in  detail  [4]  by  example. 


Vi 


-2- 


In  this  final  report  of  the  study,  a  further  conceptual  simplification 
is  made  in  the  new  syndrome  decoding  algorithm:  the  previous  syndrome  decod¬ 
ing  technique  is  changed  to  avoid  any  explicit  computation  of  the  syndrome. 

This  newest  algorithm  utilizes  a  modification  of  the  solution  of  the  syndrome 
equation  developed  earlier  [1,  2,  4]  to  directly  construct  an  error  tree--or 
its  more  compact  equivalent,  a  trellis.  Within  such  a  generated  error  trellis, 
the  minimum  weight  path  is  found,  either  by  Viterbi  or  other  sequential  decod¬ 
ing  techniques.  Finally,  this  best  estimate  of  the  path  in  the  error  trellis 
can  be  used  to  directly  correct  the  noisy  message  produced  from  received  code, 
z,  by  applying  the  right  inverse  G"1  of  the  generator  matrix  G  to  z. 

Such  a  minimum-error  trellis-path  decoder  for  (n,  k)  CCs  makes  full  and 
efficient  use  of  the  linear  nature  of  convolutional  codes.  As  such,  it  is  ex¬ 
pected  that  future  physical  realizations  of  syndrome  decoders  will  be  simpler 
and  less  costly  than  the  present-day  standard  decoders  for  CCs. 


II.  DIRECT  GENERATION  OF  ERROR-TRELLIS  AND  MINIMUM-ERROR  DECODING 

The  fundamental  algebraic  structure  of  a  CC,  the  generator  and  parity- 
check  matrices  associated  with  these  codes,  and  how  this  information  is  used 
to  compute  the  syndrome  and  to  solve  the  syndrome  equation  for  general  (n,  k) 
CCs  are  all  presented  in  considerable  detail  in  Refs.  1,  2,  and  4.  Here,  only 
a  brief  synopsis  of  these  concepts  is  given— just  enough  to  systematically 
construct  an  error  tree  or  trellis  without  resorting  to  the  intermediary  step 
of  computing  the  syndrome. 

The  Inputs  and  outputs  of  an  (n,  k)  CC  can  be  represented,  respectively, 
as  O-transforms 

OO 

x(D)  =  ^  Xj 
j=0 


(1) 
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oo 

y(o)  =  S  yj  Dd  (2) 

i=0 

kj]  and  the 

output  sequence  of  n-vectors  of  form  y..  =  [y^,  y2j,  y  ],  where  and 
y. .  belong  J;o  a  finite  Galois  field  F  =  G(q)  usually  restricted  to  the  binary 

■  J 

field  GF(2)  of  two  elements,  and  D  is  the  delay  operator.  The  input  x(D)  and 
the  output  y(D)  are  linearly  related  by  means  of  a  k  x  n  generator  matrix  G(D) 
as  follows: 

y(D)  =  x(D)  G(D)  ,  (3) 

where  the  elements  of  G(D)  are  assumed  usually  to  be  polynomials  over  the  finite 
field  GF(q) ,  where  q  is  the  power  of  a  prime  integer.  The  maximum  degree  M  of 
the  polynomial  elements  of  G(D)  is  called  the  memory  delay  of  the  code,  and  the 
constant  length  of  the  code  is  K  =  M  +  1. 

In  order  to  avoid  catastrophic  error  propagation,  the  encoder  matrix  G(D) 
is  assumed  to  be  basic  (see  Refs.  2  and  4  for  more  discussion  of  this  issue). 

.For  the  basic  encoder,  the  Smith  normal  form  of  G(D)  is 

G  =  A  [lk,  o]  B  ,  (4) 

where  A  *  A(D)  is  a  k  x  k  Invertible  matrix  with  elements  in  F[D],  the  ring 
of  polynomials  in  D  over  F,  and  B  «  B(D)  Is  an  n  x  n  Invertible  matrix  with 


of  the  input  sequence  of  k-vectors  of  form  x^  =  [x^,  x2j,  ...»  x 


elements  in  F[D].  The  elements  of  the  inverses  A"1  and  B'1  of  matrices  A  and 
B,  respectively,  are  polynomials  In  F[D], 

By  definition,  the  parity  check  matrix  associated  with  G  *  G(D)  is  any 
full -rank  (n  -  k)  x  n  matrix  with  polynomial  elements  in  F[D]  which  satisfies 

G(D)  HT(d)  -  0  ,  (5) 
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where  "T"  denotes  matrix  transpose.  A  modification  of  the  method  of  Forney 
[5]  is  used  to  find  H.  The  method  involves  a  partitioning  of  matrix  B  in 
Eq.  (4),  as  well  as  its  inverse  B"1 .  That  is,  let 


B-1  -  [f,,E2]  , 

where  the  first  k  rows  of  B  constitute  submatrix  B^  and  the  remaining  (n  -  k) 
rows  are  matrix  B2,  and  where,  likewise,  the  first  k  columns  of  B"1  constitute 
submatrix  and  the  remaining  (n  -  k)  columns  are  matrix  B2. 

Since  B  times  its  inverse  B"1  is  the  n  x  n  identity  matrix,  the  following 
identities  hold  (see  Ref.  1): 

B1  *1  =  *k  »  B1  ^2  =  0 
b2  F1  =  0  ,  b2  b2  =  In_k  . 

In  terms  of  partition,  Eq.  (7),  the  Forney  parity-check  matrix  is  defined  by 

H  =  B2T  . 

It  is  readily  verified  using  Eq.  (4)  and  identities  of  Eq.  (8)  that  Eq.  (9), 
in  fact,  satisfies  Eq.  (5),  the  requirement  for  H  to  be  a  parity-check  matrix. 
It  should  be  noted  that  the  parity-check  matrix  is  not  unique.  For  example,  it 
has  been  shown  [1]  that  H  =  C  B2T  is  a  parity-check  matrix  where  C  is  any 
(n  -  k)  x  (n  -  k)  invertible  matrix  with  elements  in  F[D]. 

For  an  input  message  x(D)  as  defined  in  Eq.  (1),  the  encoded  message  or 
code  sequence  is  y(D)  as  generated  by  Eq.  (3).  Suppose  y  =  y(D)  is  trans¬ 
mitted  and  that  z  =  z(D)  is  received.  Then,  the  transmitted  and  received 


codes  are  related  by 


z(D)  =  y(D)  +  e(D)  , 

where  e(D)  is  the  D-transform  of  the  error  sequence.  The  syndrome  of  the  re¬ 
ceived  code  z(D)  is 

s(D)  =  z(D)  =  HT(d)  . 

If  y(D)  in  Eq.  (3)  is  substituted  in  Eq.  (10),  then  the  syndrome,  com¬ 
puted  in  Eq.  (11),  satisfies,  by  Eq.  (5), 


This  is  the  syndrome  equation  for  the  error  sequence  e  =  e(D).  The  syndrome 
equation,  Eq.  (12)  shows  that  the  syndrome,  computed  by  Eq.  (11),  is  func¬ 
tionally  independent  of  the  original  transmitted  code  y(D)  as  well  as  the 
original  message  x(D). 

The  problem  of  syndrome  decoding  of  convolutional  codes  is,  as  for  block 
codes,  to  solve  the  syndrome  equation,  Eq.  (12),  for  the  set  of  all  possible 
solutions  e  *  e(D).  It  has  been  shown  [1]  that  this  set  of  solutions  is  a 
coset  of  the  set  of  all  codewords. 

To  explicitly  solve  the  syndrome  equation,  Eq.  (12),  substitute  H  as 
given  by  Eq.  (9)  in  Eq.  (12),  thereby  obtaining 

s  =  e  ^  °  e  B 

where  I  k  is  the  identity  matrix  of  (n  -  k)  rows.  In  Eq.  (13),  let 


so  that  Eq.  (13)  becomes  the  simple  equation 


s  =  e 


(15) 


where  s  *  [s^,  Sg.  •••»  sn_|<]  an(*  e  =  [ep  e2»  •••»  ejc] -  The  general  solution 
of  Eq.  (15)  over  the  ring  F[D]  is  given  evidently  by 


•  •  •  9 


k+2’ 


£k]=  lTVTV 
....  en]  =  [sr 


(16) 


where  Tj  *  Tj(D)  are  arbi trary  elements  in  F[D].  Thus,  more  compactly,  the 
general  solution  of  Eq.  (14)  is 


e  =  [  r ,  s]  =  e  B"1  ,  (17) 

where  r,  as  in  Eq.  (16),  is  an  arbitrary  k-vector  of  elements  in  ring  F[D]. 

Finally,  a  multiplication  of  both  sides  of  Eq.  (17)  by  B  yields 


■  T  B-|  +  s  Bg 


(18) 


in  terms  of  submatrices  B^  and  B2  in  Eq.  (6)  as  the  most  general  solution  of 
the  syndrome  equation,  Eq.  (12). 

The  general  solution,  Eq.  (18),  of  the  syndrome  equation  can  be  expressed 
in  a  number  of  different  forms.  For  example,  in  Ref.  1,  it  is  shown  how  it 
can  be  put  into  a  canonical  form  originally  found  heuristically  by  Vinck, 
dePaepe,  and  Schalkwijk  [6].  Herein,  it  is  desired  to  put  Eq.  (18)  in  a  form 
which  makes  it  possible  in  the  syndrome  decoding  process  to  bypass  the  explicit 
computation  of  syndrome  s(D). 
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Towards  this  end,  note  first  from  Eq.  (4),  the  Smith  normal  form  of  the 
basic  encoder,  that 

A_1  G  =  [lk,  o]  B  =  B1  . 

Next,  substitute  into  Eq.  (18)  both  this  value  for  B1  and,  by  Eqs.  (9)  and 
(11),  the  quantity  z  B2  for  syndrome  s.  These  substitutions  yield 

[t  A"1  I  G  +  z| 


=  (r  A-')g+  z(b2  B2) 


(19) 


in  terms  of  received  code  z  for  the  general  solution  of  the  syndrome  equation. 

Since  t  is  an  arbitrary  k-vector, 

t  =  r  A'1  (20) 

is  also  an  arbitrary  k-vector  of  elements  in  F[D] .  In  Eq*  (19),  let  R  be  the 
n  x  n  matrix  ^  B2*  Since  B2  and  ^  ^ave  ranfcs  (n  "  k)»  it  can  be  shown  that 
matrix  R  =  \  B2»  where  B2  and  B2  are  defined  in  E9S-  (6)  and  (7),  respectively, 
also  has  rank  (n  -  k). 

A  substitution  of  Eq.  (20)  and  R  into  Eq.  (19)  yields 


Here,  R  is  the  n  x  n,  rank 


e  =  t  G  +  z  R 

as  the  general  solution  of  the  syndrome  equation. 

(n  -  k)  matrix 

R  =  b2  , 

t  Is  an  arbitrary  k-vector  of  elements  In  F[D],  and  z  is  the  D-transform  of 
the  received  code  sequence. 

Le*.  z{D)  *  .  any  finite-length  received  code.  By  the  maximum  likelihood 
principle  the  most  likely  error  sequence  Is  the  one  with  minimum  Hamming 
weight.  Given  z(D),  the  sequence  e(D)  with  minimum  Hamming  weight  Is  found 


(21) 


(22) 
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by  minimizing  the  weight  of  the  right  side  of  Eq.  (21)  over  all  polynomials 
t(D)  in  F[D].  That  is. 


t  e  F[D] 


t  G  +  z  R 


where  z  =  z(D)  is  the  D-transform  or  polynomial  of  any  finite-length  received 
code  and  "  ||  x  || "  denotes  the  Hamming  weight  or  "norm"  of  element  x  =  x(D) 
in  F[D]. 


The  minimization  required  in  Eq.  (23)  is  analogous  to  certain  optimum 
nulling  techniques  in  control.  Sequence  r(D)  =  z(D)  R(D)  j[s  the  error  sequence 
for  the  zero  input  message,  i.e.,  for  t(D)  =  0.  What  one  attempts  to  do  in 
Eq.  (23)  is  to  find  that  message  sequence  t  which,  when  encoded  as  t  G  and 

A 

subtracted  from  r(D),  yields  the  sequence  e  of  minimum  Hamming  weight.  That 
is,  if  t  =  t(D)  is  the  D-transform  for  which  J |  e  | J  =  ||  t  G  +  z  R  j|  is  a 
minimum,  then 


e  =  t  G  +  z  R 


is  the  D-transform  of  the  minimum-weight-possible  error  sequence. 


By  Eq.  (4),  the  right  inverse  G”1  of  the  generating  matrix  G  is 


G"1  =  B"1  k  A"1 


This  is  verified  by  multiplying  G  in  Eq.  (4)  on  the  right  by  G‘  in  Eq.  (25). 
Multiplying  both  sides  of  Eq.  (24)  on  the  right  by  G"1  in  Eq.  (25)  yields,  by 
Eqs.  (7)  and  (8),  the  identity 


e  G"1  =  t  G  +  z  F2  B2  G-1  = 


t  +  z  ^  B2  ,  I2 


•  *  +  2  *2  °-  >n-k 


['kl  A"’ 
0 


■1/  _1  ~ 

K  A  1  =  t  . 


V-  ■>  >s  .  ^  .v  V.VLV.-.*-WwV.-u,'.n,,Zv\v''.n,.v.v\%\vV 
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A  A 

By  Eq.  (10),  the  subtraction  of  e  from  z  produces  a  best  estimate  y  of 


the  transmitted  code,  i.e.. 


y  =  z  +  e  . 


The  best  estimate  y  of  the  code,  if  multiplied  on  the  right  by  G,  yields 

A  A  I 

x  =  yG‘'  , 

the  best  estimate  of  the  original  message.  Hence,  substituting  Eq.  (27)  in 
Eq.  (28)  and  using  Eq.  (26)  produces 

x  =  (z  +  e)G_1 
-1 

=  z  G  +  t  . 

A  A 

This  important  identity  shows  that  t  =  t(D),  obtained  by  the  minimization  in 
Eq.  (23),  is  a  correction  factor  to  the  standard  method  of  recovering  the 
message  from  z  =  z(D)  if  z  were  noise-free. 

In  the  following  section,  the  techniques  of  performing  the  minimization 

A  A 

in  Eq.  (23)  for  finding  e  and  t  are  discussed.  Included  in  these  methods  are 
the  Viterbi  dynamic  programming  algorithm  and  all  of  the  sequential  decoding 
techniques.  An  interesting  new  suboptimal  method  for  finding  e  is  the  piece- 

A 

wise  L-step  minimum-error  path  technique  for  finding  e,  developed  below. 


'V  -S' 

W 


III.  PIECEWISE  L-STEP  MINIMUM-ERROR  DECODING 

In  this  section,  a  new  piecewise  L-step  minimum-error  decoder  is  developed 
by  example.  The  encoder  is  the  (3,  1)  CC  described  in  Ref.  6,  Chapter  12,  and 
also  used  in  Ref.  4  for  an  example.  For  ease  of  description  and  for  compara¬ 
tive  purposes,  many  of  the  parameters  used  in  Refs.  4  and  6  are  also  used  here. 
The  generator  matrix  of  the  above-mentioned  (3,  1)  CC  is 


=  [l  +  D,  1  +  D2,  1  +  D  +  D2]  . 
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The  Smith  normal  form,  Eq.  (4),  of  this  generator  is 


G  =  [  1  0  0  ]  B  , 


where 


1  +  D,  1  +  D2,  1  +  D  +  D2 


B  =  0 


The  inverse  of  B  is  obtained  readily  as 


1 ,  1  +  D  ,  D 

B"1  =  1,  D2  ,  1  +  D 

_1,  1  +  D2,  1  +  D J  . 

Applying  Eqs.  (6)  and  (7)  to  Eqs.  (32)  and  (33)  yields 


'Oil' 

B2  =  and  lJ2 

L  l  o  l  J 


1  +  D  ,  D 
D2  ,  1  +  D 
1  +  D2,  1  +  D 


Hence,  by  Eq.  (22),  matrix  R  is 


D  ,  1  +  D2,  1  +  D  +  D2 

R  =  B2  B2  ■  1  +  D,  D2  ,  1  +  D  +  D2 

.  1  +  D,  1  +  D2,  D  +  D2 


and,  in  Eq.  (21), 


r  =  z  R  =  [z1#  z2,  z3]  R 
■  0  z2+(.+0^3, 

(,+d  +  d2)z)+(,  +  d  +  d2)z2+(d  +  o2)z3 
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Use  the  data  In  the  example  of  Ref.  4  for  z;  namely, 

z1  -  [  1  1  1  1  0  1  0  ]  , 
z2  =  [ 1  1  1  1  1  0  0  ]  , 

and 

z3  =  [  0  0  0  1  1  1  1  ]  . 

Then,  the  r-sequence  z  R  in  Eq.  (36),  needed  for  Eq.  (23)7  is  computed  as 


follows: 


Z2  : 

11111 

0  0 

D  z2  : 

1111 

1  0  0 

D  Z1  : 

1111 

0  1  0 

z3  : 

0  0  0  1  1 

1  1 

D  z3  : 

0  0  0  1 

1  1  1 

rl  a 

1110  1 

1  1  1  0  ] 

Z1  : 

11110 

1  0 

Dzl  : 

1111 

0  1  0 

O2  z,  : 

1  1  1 

10  10 

z2  : 

11111 

0  0 

D  z2  : 

1111 

1  0  0 

O'  z2  : 

1  1  1 

110  0 

D  z3  : 

0  0  0  1 

1  1  1 

D2  z3  : 

0  0  0 

1111 

r3 

[o  0  0  0  0  0  0  1  1  1 

z1  :  11110  10 

D2  z7  :  1111010 

D2  z2  :  1111100 

z3  :  0  0  0  1  1  1  1 

D2  z3  :  0001111 

r2  -  [  1  1  1  0  1  1  1  0  1  ] 


Hence,  the  sequence  r  as  a  D-transform  is 
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*,e* 


a 


M 


r(D)  =  z(D)  R(D)  =  [l  1  o]  +  [i1o]d+[i1o]d2 

+  [  1  1  0  ]  D4  +  [  1  1  0  ]  D5 
+  [  1  1  0  ]  D6  +  [  1  0  1  ]  D7  +  [oil] 


or  simply  as  a  sequence 


r  =  [l  1  0,  1  1  0,  1  1  0,  0  0  0,  1  1  0  ,  1  1  0,  1  1  0,  1  0  1,  0  1  1  ]  . 


The  trellis  diagram  for  the  encoder  of  the  (3,  1)  CC  is  shown  in  Fig.  1. 
Next,  in  Fig.  2,  is  shown  the  one-step  minimum-error  path  for  sequence  r  in 
Eq.  (37),  the  example  in  Ref.  4.  The  sequence  r  =  z  R  is  shown  at  the  top  of 


the  partial  trellis  as  a  function  of  step,  r  would  have  been  the  error  se¬ 


quence  if  the  message  had  been  x  =  0,  At  steps  4  and  7,  for  example,  r  = 

[  1  1  0  ]  and  r  =  [  1  0  1  ]  ,  respectively. 

The  path  in  Fig.  2  is  obtained  by  performing  the  minimization  in  Eq. 
(23)  on  a  step-by-step  basis.  For  example,  at  step  0  by  the  encoder  trellis 


in  Fig.  1,  there  are  two  possible  paths:  one  path  has,  by  Eq.  (21),  e 


1  1  0  -  0  0  0  =  1  1  0,  and  the  other  has  e  =  1  1  0  -  1  1  1  *  0  0  1.  Since 


the  latter  path  has  minimum  Hamming  weight,  the  path  a  +  c  is  chosen  with 

A 

t  *  1.  Next,  at  step  1  and  starting  at  state  c,  there  are  again  two  possible 

choices:  by  Fig.  3,  one  choice  is  path  c  ■*>  b  with  e  =  1  10-101*01  1; 

the  other  choice  is  path  c  d  with  e  «  1  1  0  -  0  1  0  *  1  0  0.  Again,  since 

jj  0  1  1  ||  =  2  >  ||  1  0  0  ||  =  1 ,  path  c  d  is  chosen  and  t  *  1  1.  This 

process  repeats  until,  finally,  t*[ll011010o]  up  until  step  9. 

It  is  evident  that  the  simple  one-step  minimum-error  path  decoding  pro¬ 


cess  illustrated  above  produces  a  value  of  t  which  is  the  same  as  the  value 


of  t  found  by  the  substantially  more  complicated  sequential  decoding  processes 


described  In  both  Ref.  4  and  Ref.  6  for  moderate  noise  levels.  In  fact,  this 
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Fig.  1  -  ire " 1  diagram  for  encoder  of  (3,  1)  convolutional  code 

[Note:  Dashed  line  corresponds  to  x  *  1; 
bold  line  corresponds  to  x  -  0] 

♦ 


error  P»«i  decoding  for 


-16- 


m 


5  •$ 
1  ' 


m 


new  decoding  process  is  ideally  suited  to  high-rate  (n,  k)  convolutional  codes, 
where  the  channel  noise  is  moderate. 

The  piecewise  two-step  minimum-error  decoding  procedure  is  illustrated 
for  the  "very  noisy"  example  in  Ref.  5  (p.  357,  Example  12.5).  For  this  ex¬ 


ample. 


=  [  1  1  0,  1  1  0,  1  1  0,  1  1  1,  0  1  0,  1  0  1,  1  0  1  ] 


and  r  =  z  R  is  computed,  by  Eq.  (36),  to  be 

r  *  [  1  1  0,  1  1  0,  1  1  0,  0  0  0,  0  0  0,  0  1  1,  1  1  0,  0  0  0,  0  0  0  ]  , 

which  is  listed  at  the  top  of  the  partial  trellis  in  Fig.  3.  In  the  two-step 
process,  minimum  path  segments  of  two  steps  are  found  and  pieced  together  to 

A 

form  an  estimate  of  t. 

Starting  at  step  0  and  state  a,  the  values  of  e  are  found  using  Eq.  (21) 
and  Fig.  1  for  the  four  path  segments  between  steps  0  and  2.  The  Hamming 

weights  of  the  four  possible  two-step  segments  are  used  then  to  determine  the 

two-step  path  of  minimum  weight,  which,  in  this  case,  is  the  unique  path  a  -*• 

A 

c  •>  d  of  weight  2  and  with  t  =  1  1.  In  a  similar  fashion,  the  unique  minimum 
two-step  path  segment,  starting  at  step  2  at  state  d,  isd-*b-*-c.  As  a  con¬ 
sequence,  the  minimum  path  between  step  0  and  step  4  is  a  +  c  +  d  b  c,  for 
which  t  *  1  1  0  1. 

The  two-step  segment  of  path  between  steps  4  and  6  is  not  unique.  A  min¬ 
imization  over  the  four  possible  paths  yields  two  path  segments,  c  -*■  b  a  and 
c  +  d  +  d,  both  of  which  equal  Hamming  weight  2.  From  one  point  of  view,  such 
a  tie  could  be  called  a  decoding  failure,  particularly  since  the  free  distance, 
dfree»  of  3  for  this  code  has  been  exceeded  along  either  path  by  a  total  Hamming 
distance  of  5  within  a  code  length  which  about  equals  the  minimum  truncation 
length,  t  .  ,  of  5  •  3  *  15.  However,  it  is  more  customary  with  convolutional 
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codes  to  continue  to  track  both  paths  until  either  they  merge  or  one  track 
definitely  has  a  smaller  Hamming  weight  than  the  other.  If  such  a  criterion 
Is  Incorporated  into  the  decoding  algorithm,  the  upper  path,  namely,  a  -*■  c 
d->b-+c  +  b-+a-*-a-*-a-*-a,  with 

t  -  [  1  1  0  1  0  0  0  0  0  ]  . 

eventually  wins  out. 

Given  that  the  received  sequence  z  is  Eq.  (38)  and  that  the  decoder  pro- 
duces  t  as  the  estimated  correction  factor,  it  is  now  desired  to  find  x,  the 
estimated  message  from  Eq.  (29).  By  Eqs.  (25),  (31),  and  (33), 


(39) 
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1,  1  +  D2, 
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Hence,  by  Eq.  (29), 


;  ■  I*-1  + 1 .  zj.  z3] 


+  t 


(40) 


Z]  +  z2  +  z3  +  t  . 


1 


Applying  Eq.  (40)  to  z  and  t  in  Eqs.  (38)  and  (39),  respectively,  yields 

11110  11 
1111100 
0  0  0  1  0  1  1 
1101000 
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Hence, 

x(D)  =  1  +  D  +  D4 

is  the  best  estimate  of  the  transmitted  message.  This  agrees  with  the  result 
obtained  by  Lin  and  Costello  [6,  p.  358]  using  the  stack  sequential  decoding 
algorithm. 

The  piecewise  L-step  minimum-error  decoding  partially  developed  in  this 
section  to  find  the  minimum-error  trellis  path  by  the  criterion  of  Eq.  (23) 
is  sufficiently  simple  compared  with  other  decoding  critteria  to  warrant  more 
study.  For  example,  on  heuristic  grounds  and  to  achieve  the  best  results,  it 
is  believed  that  L  should  either  equal  M,  the  memory,  or  K  =  M  +  1 ,  the  con¬ 
straint  length  of  the  code. 

/ 

IV.  CONCLUDING  REMARKS 

^ In  this  final  report  on  a  one-year  study  of  syndrome  decoding  techniques, 
the  results  of  previous  studies  [1,  2,  3,  4]  are  extended  and  applied  to  the 
development  of  a  new  class  of  minimum-error  trellis-path  decoders  for  (n,  k) 
convolutional  codes.  Also,  a  new  method  is  devised  by  example  for  finding  the 
minimum-error  trellis  path.  This  promising  technique  is  called  piecewise 
L-step  minimum-error  decoding.  Other  more  standard  decoding  methods  can  also 
be  used  to  find  the  minimum-error  trellis  path,  such  as  a  Viterbi-like  algo¬ 
rithm  and  the  various  sequential  decoding  techniques.  v 

It  Is  difficult  to  estimate  the  Importance  to  the  military  of  improving 
the  capability  of  convolutional  decoders.  Right  now,  there  is  no  known  method 
for  satisfactorily  decoding  high-rate  convolutional  codes  and.  In  most  commu¬ 
nications,  high-rate  transmission  is  very  desirable.  Viterbl  decoders  cannot 
be  designed  with  the  present  VHSIC  technology  to  handle  convolutional  codes  of 
constraint  lengths  of  greater  than  7  and  with  rates  greater  than  1/2.  Finally, 


sequential  decoders  work  fine  in  a  benign  environment.  But,  with  even  the 
slightest  interference  or  jamming,  sequential  decoding  exhibits  long  queues 
or  almost  complete  decoding  failure. 

In  view  of  these  reasons,  much  attention  has  been  given  in  the  present 
study  to  new  algorithms  which  might  lead  to  substantial  reductions  in  cost 
and  complexity  while  achieving  decoding  readability.  It  is  believed  that 
_the  class  of  minimum-error  trellis-path  decoders  developed  in  this  and  the  pre¬ 
vious  reports  submitted  on  this  study  provide  a  new  and  feasible  approach  to 
these  important  goals. 
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